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We study the noisy dynamics of a close relative to the sand pile model. Depending on the type of 
noise and the time scale of observation, we find stationary fluctuations (similar to SOC) or an aging 
dynamics with punctuated equilibria, a decreasing rate of events and reset properties qualitatively 
similar to those of glassy systems, evolution models and vibrated granular media. 
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INTRODUCTION 

The 'pulse-duration memory effect' observed Q in slid- 
ing Charge Density Wave systems was explained by Cop- 
persmith and Littlewood || using a microscopic non- 
linear model of interacting degrees of freedom with a huge 
number of dynamically inequivalent attractors. Related 
work by Tang, Wiesenfeld, Bak, Coppersmith and Lit- 
tlewood H (henceforth TWBCL), emphasized that the 
relatively rare minimally stable attractors of this model 
are nonetheless those preferably selected by the dynam- 
ics. The sand pile model and SOC then evolved j| from 
the analysis of the TWBCL model, with its poised state 
being conceptually similar to a minimally stable state. 
A sand pile || reacts to small disturbances by releasing 
avalanches with a broad distribution of sizes, returning 
then to its poised state described by the angle of repose. 

While SOC deals with the stationary fluctuations of 
extended systems, a wide class of systems is manifestedly 
non-stationary, since the relevant macroscopic variables 
slowly change in time at a decelerating rate. This implies 
a dependence of the data on the initial time and hence 
on the age of the system. Relevant examples are spin 
glasses H [7| ||, the evolution of bacterial cultures 0, 
evolution in rugged fitness landscap es [10|, lit macro- 
evolution |l3|, [l4| , granular systems Jl5 , |l6| and Lennard- 
Jones glasses |f7f . In spin glasses and glasses, aging be- 
havior is usually analyzed in terms of functions with two 
time arguments as e.g. magnetic correlations and lin- 
ear response. Since at 'short' times t < t w these fulfill 
the Fluctuation Dissipation Theorem, one can infer that 
the system performs equilibrium-like fluctuations in this 
regime flTijj] . For t > t w the FDT is broken and the non- 
stationary nature of the dynamics becomes apparent. In- 
timately linked to non-stationarity is the reset capability 
of aging systems, i.e. the possibility of enhancing the rate 
of relaxation, thus 'resetting' the system's apparent age 
to a smaller value by tweaking parameters such as e.g. 
temperature and/or magnetic field 0, ffl. 

Below we use the TWBCL model, whose attractors are 
explicitly known, for a case study of the aging of non- 
thermal systems with multiple metastability. Being par- 
ticularly interested in the connection between the coarse 



grained dynamics and the attractor structure, we find 
it convenient to consider the presence of two dynamical 
regimes, pseudo-stationary for t < t w and non-stationary 
for t > t w , together with the reset capability as the cen- 
tral properties of aging dynamics. These properties are 
shared by spin glasses and glasses, but not by e.g. the 
Bak-Sneppen |19|| evolution model, whose macroscopic 
variable (the average fitness) remains constant in time. 
Nonetheless, this model has other interesting age depen- 
dent properties, as discussed in Ref. fl20f. 



THE TWBCL MODEL 

In spite of its out most simplicity, the TWBCL model 
with added noise has interesting aging properties: The 
relevant macroscopic average, here called the degree of 
phase organization ||x|| , remains nearly constant on scales 
t < t w , and the noise induced fluctuations are avalanches 
(SOC like in two dimensions). For t > t w a logarithmic 
decrease of j|x|| becomes apparent, revealing that the at- 
tractors visited become more stable as the system ages. 
The decay of can be reset by a change of the elas- 
tic constant, whereby the system is rejuvenated. All this 
behavior can approximately be accounted for by a mech- 
anism previously dubbed pl} | noise adaptation, which is 
also present in the dynamics of populations evolving in 
rugged NK landscapes [ jlfl . 

Consider M 'balls' arranged in an array (linear or 
square) and coupled to their neighbors via springs with 
elastic constant K. The balls are subject to friction, to 
a force with a sinusoidal spatial variation, and to a se- 
ries of square pulses of amplitude E. In the limit of high 
damping, large field and weak elastic coupling, the key 
dynamical features are captured by the simple update 
rule Q reproduced below (with ID notation): 

zj(t) = yjW + KAiyityj+E + Njit), 
y 3 {t + l) = nint(^(i)). (1) 

Here, t is the time in units of field cycles, Zj is the coor- 
dinate of the j'th ball, A is the lattice Laplacian, nint(z) 
stands for the integer nearest to z and Nj is the noise 
applied at site j. For N = 0, integer valued E and free 
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FIG. 1: Broad, power-law like distributions are observed for 
both avalanche sizes (left panel) and durations in a 30 x 30 
model with K — 0.05. The system is subject to noise 
pulses drawn from an exponential distribution with average 
a = 0.01 and the avalanches are monitored through 100 per- 
turbation/relaxation cycles starting at three different ages t w . 
The age is here the total number of cycles the system has un- 
dergone before sampling the statistics. As t w increases the 
avalanches become smaller and shorter. 



or periodic boundary conditions, the attractor states of 
Eq. (|l|) satisfy || mnt(Kc) = 0, where c = Ay is the 
curvature vector. The corresponding coordinates then 
fulfill 



— < Kci <- 7 = 1, 
2 2 



. M. 



(2) 



The attractors |22j thus lie within an attractor hypercube 
of side length 1 / K centered at the origin. Their number 
is 0(1/K M ), which is huge when, for example, M f» 200 
and K = 0.05. 

Noiseless relaxation of an initial state generally leads to 
a phase organized state jjj, i.e. a state located at the cor- 
ners of the attractor hypercube. Such state is minimally 
stable against external perturbations, as it barely fulfills 
Eq. (||). The average ||x|| = A/ -1 ^ Xi | is always 
defined and gauges, for attractors, the degree of (meta) 
stability ||x||, or, equivalently, the depth d = 1/2 — ||x||. 
Minimally stable attractors have d f» 0. 



Noisy relaxation properties 

We always start the noisy dynamics at a phase orga- 
nized state selected under noiseless conditions, and de- 
note the time elapsed under the influence of noise by t w , 
the age of the system. As we anticipated, the evolution 
has a first (pseudo) stationary phase involving fluctua- 
tions among meta-stable states of the same depth. On 



longer time scales the average depth of the attractors vis- 
ited increases logarithmically through a series of jumps, 
also denoted macroscopic events or punctuations. Cru- 
cially, t w demarks the boundary between short and long 
time dynamics. As shown by Fig. ^, our macroscopic av- 
erage 1 1 a; 1 1 decreases in a logarithmic fashion, apart from 
a superimposed oscillation which is most clearly visible 
for small noise amplitudes. Let c be the logarithmic slope 
of ||x||, which is shown in the second panel of Fig. || and 
assume that the observation window extends from t w to 
t + t w . Since ln(t + t w ) = ln(t w ) + ln(l +t/t w ), it follows 
that 



\\x\\(t + t w ) « \\x\\(t w )-cln(l + t/t w ). 



(3) 



Considering that ln(l + t/t w ) w t/t w and that c << 1, 
we see that \\x\\ does not change appreciably as long as 
t/tw < 1- Hence, the dynamics appears stationary for 
t <t Wl as claimed. 

We can reach the same conclusion by a second ar- 
gument, which will help us to connect with the land- 
scape structure of the problem: By definition, consecu- 
tive macroscopic events always delimit the observation 
window during which the dynamics appears as station- 
ary. Secondly, as we will show later, the residence time 
t r characterizing the attractors which are first visited at 
time t w fulfills (within an order of magnitude) 



t„ 



(4) 



Hence the dynamics appears stationary within the in- 
terval t < t r « t w . Interestingly, Eq. (0) constitutes 
the main assumption of weakly broken ergodicity p3, a 
widely used scenario for complex system relaxation. The 
same equation also describes a property of diffusion on 
hierarchical tree models | 23 , 2^, ^(| , models which repro- 
duce many features of glassy relaxation. 

Figure |l| illustrates the nature of the 'short time' 
avalanche dynamics. The noise used to produce the data 
consists of a series of 'kicks' of either sign, simultaneously 
applied to each 'ball' and independently drawn from an 
exponential distribution with average a. Relaxation to 
a fixed point is allowed between consecutive perturba- 
tions, and the avalanches consist of sets of contiguous 
'balls' simultaneously in motion. Their sizes are defined 
as the largest number of participating balls. Both size 
and duration are exponentially distributed in ID, and 
power-law distributed in 2D, as expected j27j. The main 
message of Fig. |l| is simply that avalanches are larger 
and last longer in a young system (upper curve) than in 
an aged one (lower curve). This is a first indication of 
decelerating dynamics. 

Pulsed noise can model systems where the typical 
avalanche duration and the length of the noiseless pe- 
riods are well separated pj| . To bypass this restriction 
we now apply the noise 'continuously', i.e. at each time 
step. The coarse grained time evolution in state space 
can then be followed by monitoring ||o:|| (£„,). 
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FIG. 2: Aging in a 1000 x 1 model with K = 0.05, randomly 
perturbed by white noise with exponentially distributed mag- 
nitude of a. Each curve in the left panel belongs to a different 
value of a and is the average over ten independent trajec- 
tories, starting from the same minimally stable state. After 
a short transient, the decay is logarithmic (with a superim- 
posed oscillation). In the right panel, the logarithmic slopes 
are shown versus a. A line of unit slope is included to guide 
the eye. 
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FIG. 4: A 1000 x 1 model with K = 0.05 is perturbed through 
a few thousand updates by noise of bounded variation [—a, a] 
and then allowed to fully relax, reaching the ||a;|| values which 
are plotted (as stars) versus a for five independent noise se- 
quences. In addition, the line y = 0.45 — a is drawn as a guide 
to the eye. Since ||x|| decreases almost proportionally to a, 
the least stable among the attractors surviving the noise are 
those dynamically selected with high probability. 
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FIG. 3: Changing the elastic constant from K = 0.03 to 
K = 0.05 and again to K = 0.07 produces the 'resets' seen 
at times 2 • 10 3 and 2 ■ 10 4 . The data are averages over 20 
different trajectories of a linear array of 1000 'balls'. The 
noise magnitude is exponentially distributed with average a = 
0.015. 



Averaging suppresses all fast fluctuations together with 
the spatial information, and H^IK^) therefore consists of 
constant plateaus, punctuated by rapid changes. These 
mainly lead to deeper attractors and stand out as the 
coarse grained dynamical events on long time scales. 
Complementary information is obtained by averaging ||x|| 
over independent noise histories. The resulting smooth 



function, (]]a;||)(f TO ) was studied for both ID and 2D sys- 
tems, using pulsed as well as continuous noise. Since 
(||a;||) is rather insensitive to the dimension, we mainly 
studied it for ID models, which are faster to simulate. 
The left panel of Fig. || shows the time evolution of 
f° r different values of the noise magnitude a. 
The negative logarithmic slope of the plots has a linear 
relationship to the amplitude a which is shown in the 
right panel of the same figure. 

The age-reset is induced in our model by changing the 
elastic constant, which is analogous to changing the mag- 
netic field p9| in spin glass systems. Increasing K re- 
duces the size of the attractor hypercube and concomi- 
tantly reduces the depth of the current state. As a conse- 
quence is reset to an earlier (and larger) value, 
as shown in Fig. g. Decreasing K has the effect of swelling 
the attractor hypercube whence quickly drops. 

To further clarify the connection between the reset 
effect and the attractor geometry, we consider bounded 
noise [ pl| drawn from a uniform distribution supported 
in the finite interval [—a, a]. Equation (Q) then implies 



that only states fulfilling max.,{l/2- 



|}> 



a survive 



as exact fixed points of the equations of motion. The 
corner states of an attractor hypercube of side length 
(1 — 2a) /K are still minimally stable, in the generalized 
sense that any infinitesimal increase of the noise ampli- 
tude destroys their stability. Figure |] demonstrates that 
a perturbation of magnitude a permanently leaves the 
system in an attractor of depth w 0.45 — a. Hence the 
minimally stable states are dynamically selected. 
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For exponentially distributed noise of average magni- 
tude a and on a time scale t w , the kicks normally fall 
within the range r t sa a\nt w . Hence we expect that the 
trajectories will typically be located at the corners of a 
hypercube of side length 2(||x||) « (1 — 2a\nt w ). This 
is in reasonable agreement with the behavior depicted in 
the right panel of Fig. ^| and explains why even a modest 
shrinking of hypercube produces a sizable reset. Since 
the attractors typically discovered on a given time scale 
are the shallowest among those available, we expect that 
a record in the sequence of noise kicks will likely suf- 
fice to produce a macroscopic event, a feature previously 
dubbed noise adaptation 

If macroscopic events are induced by noise records, 
their number n e (t w ) during time t is a log-Poisson pro- 
cess pjj. As a consequence, if tk denotes the time of 
the fc'th event, the quantities Ak = ln(ife/f/._i) are sta- 
tistically independent and have the common distribution 
Prob(A > x) = exp(— Ax), for some positive A. Secondly, 
the average number of events grows as (n e ) (t w ) = A In t w . 
From Fig. || we see that the actual statistics of macro- 
scopic events resembles a log-Poisson statistics in the 
shape of (n e ) (plot A) and in the fact that the log- waiting 
times have very short correlations (plot C) and an expo- 
nential distribution (plot D). 

Crucially, Fig. || D shows that the event times tk ap- 
proximately make up a geometrical series. Hence, in a 
system of age t w , most time is spent in the neighborhood 
of the last attractor visited. Therefore, the residence 
time in a neighborhood of the fc'th attractor discovered 
is t r = tk — tfc-i ~ tk — t w , as anticipated in Eq. (U|). 



SUMMARY AND CONCLUSION 

On short time scales the space resolved dynamics of the 
TWBCL model can be described in terms of avalanches 
having, in two spatial dimensions, SOC-like character. 
On longer time scales the applied noise pushes the sys- 
tem into gradually more stable attractors. As a conse- 
quence, the degree of phase organization ||x|| decreases 
logarithmically in time. This differs from the sand pile 
model and is reminiscent of the logarithmic relaxation of 
the angle of repose p5| observed in actual sand piles sub- 
ject to vibration. We have argued that the aging of the 
TWBCL model is similar to that of e.g. spin glasses in 
two important respects: i) the boundary between quasi- 
stationary and non-stationary dynamics is given by t w , 
the time elapsed from the initial quench, and ii) the dy- 
namics is resettable. The coarse grained aging dynam- 
ics is characterized by a series of 'macroscopic events' 
leading to gradually deeper attractors. The statistics of 
these events is approximately log-Poisson, an indication 
that the events themselves are strongly correlated with 
records in the history of noise. During noise adapta- 
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FIG. 5: An array of 1000 'balls' with elastic constant K = 
0.05 is perturbed by noise 'kicks' of random sign and magni- 
tude exponentially distributed with average a — 0.015. The 
noise is uncorrelated in time and space. We considered 200 in- 
dependent trajectories, all starting from the same minimally 
stable state. An 'event' is defined as the achievement of a state 
of lower ||a;||. A and B: average and variance of the number 
of events observed within time t w . C: autocorrelation func- 
tion Ca(&) of the log-waiting times = \n(tk/tk-i)' D: 
distribution of the 



tion |2l[] the attractors first visited on a time scale t w 
typically trap the trajectories for time t w , as assumed in 
weakly broken ergodicity Q . The same statistics is also 
present in the dynamics of a population of 'agents' evolv- 
ing in NK fitness landscapes with multiple optima p0| . 
If one views evolution as a search in a fitness landscape 
with multiple optima, stress-induced hyper mutation ]3C| ] 
following a change of nutrient type or concentration ap- 
pears as the biological counterpart of a reset. Thus, a 
range of complex non-stationary phenomena can be qual- 
itatively understood by invoking marginal stability and 
noise adaptation as selection mechanisms for metastablc 
attractors. 
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